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FINAL  REPORT 


Early  Detection  of  Breast  Cancer  on  Mammograms  Perceptual  Feedback, Computer 
Processed  Images  and  Ultrasound 


Grant  #  DAMD  17-93-J-3014 


Principal  Investigator;  Peter  Bloch,  Ph.D. 

Clinical  data  indicates  that  early  detection  of  breast  cancer  results  in  significantly 
higher  success  rates  in  the  treatment  of  the  disease.  Ten  year  disease  free  survival 
greater  than  95  percent  are  achieved  with  modem  treatment  when  the  breast  lesions  are 
detected  less  than  <1  cm  in  diameter.  The  goal  of  this  project  was  to  improve  the  detection 
of  small  non-palpable  lesions.  Three  methods  for  improvement  in  the  detection  of  small 
lesions  were  explored  in  this  study.  These  include: 

Project  1A:  Perceptual  Feedback  as  an  Aid  to  the  Early  Detection  of  Cancer 
on  Mammograms, 

Project  1B:  Digital  Image  Processing  of  Mammograms,  and 
Project  1C:  High  Resolution  Ultrasound  Mammography. 

In  summary  the  major  accomplishments  include: 

■  An  extensive  database  of  high  and  low  resolution  digitized  clinical 
mammograms  was  established  that  consists  of  87  mammographic  examination 
(two  films  per  study ;  a  cranial-caudal  and  a  oblique  view).  The  clinical  database 
has  pathology  confirmed  abnormal  lesions  (34  microcalcifications,  28  masses) 
and  24  normals.  This  extensive  database  was  required  to  test  the  efficacy  of 
improving  detection  of  lesions  on  mammograms  both  by  perceptual  feedback 
(project  1  A)  and  computer  image  processing  and  feature  extraction  (project  I  B). 

■  Hardware  and  software  was  developed  for  the  computer  display  of  high 
resolution  digitized  mammograms 

■  Elevated  mammographic  density  has  been  associated  in  clinical  studies 
with  an  increased  risk  of  developing  breast  cancer.  Techniques  were  developed 
and  tested  to  quantify  the  fibroglandular  tissue  automatically  from  digitized 
mammograms. 

■  Algorithms  were  developed  for  extracting  clusters  of  microcalcification 
from  the  high  resolution  digitized  mammograms 

•  Hardware  and  software  was  developed  for  recording  of  eye-position  of 
observers  while  reading  mammograms 

■  It  was  found  that  false-negative  decisions  in  reading  mammograms 
was  associated  with  prolonged  visual  dwell  time.  This  information  was  feedback 
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to  th©  obsGrver  (by  placing  a  bold  circl©  around  th©  suspicious  sit©  on  the  image) 
which  resulted  in  improved  detection  of  masses. 

■  Two-dimensional  ultrasound  breast  data  was  obtained  and  analyzed. 

■Ultrasonic  distortion  in  the  female  breast  was  lidentified  in  the  2D  dataset 

including  :{1)  phase, (2)incoherent  scatter  and  {3)muitipath  interference . 

■  Contrast  resolution  in  breast  ultrasound  imaging  was  shown  to  be 
significantly  restored  using  a  phase  deabberration  algorithm 

■  Time-delay  type  compensation  algorithms  were  developed  and  found 
to  minimize  the  scattered  energy  significantly  (15  dB) 

■  Significant  progress  was  made  in  recognizing  true  targets  from  false 
ones  caused  by  ultrasound  Interference.  We  demonstrated  that  the  image  of 
true  targets  remains  in  the  same  position  and  changes  little  in  size  or  shape 
when  imaged  from  different  array  locations. 

■  Design  consideration  was  i  performed  for  2D  large  acoustic  transducers 
for  high  resolution  breast  imaging.  The  analysis  indicated  that  the  ultrawideband 
property  of  a  2D  array  would  be  more  desirable  than  the  conventional 
narrowband  array.  This  would  result  in  fewer  array  elements  and  much  lower 
side  band  scattered  energy  . 


The  achievements  on  these  projects  are  presented  in  this  final  report. 


6 


Grant  #  DAMD17-93-J-3014 


Project  lA:  Perceptual  Feedback  as  an  Aid  to  the  Early  Detection  of  Cancer  on 
Mammograms. 

Project  Director  Harold  L.  Kundel,  M.D. 

INTRODUCTION:  RESEARCH  OBJECTIVES 

About  15%  of  tumors  that  are  actually  visible  are  missed  on  the  initial  reading  of 
screening  mammograms  [Bird  et  al.  1992].  These  misses  are  considered  to  be  perceptual 
errors.  Eye-position  recordings  made  during  the  search  for  tumors  on  chest  radiograms 
and  mammograms  have  been  used  to  classify  perceptual  errors  into  those  due  to 
incomplete  scanning  (15%),  failure  of  the  feature  recognition  mechanism  (15%)  and 
incorrect  decisions  (70%).  Decision  errors  are  associated  with  prolonged  visual  dwell  on 
the  tumor  site  in  the  image  [Kundel  et  al.  1989].  Two  observations  have  been  made  using 
chest  radiograms.  First,  when  sites  that  receive  prolonged  visual  dwell  during  primary 
reading  are  identified  and  marked  by  circling,  immediate  re-evaluation  results  in  an 
improvement  in  accuracy  [Kundel,  et  al.,1990].  Second,  circling  a  tumor  site  increases  the 
readers  ability  to  detect  a  tumor  [Krupinski  et  al.,1993]. 

This  project  will  extend  the  observations  made  on  chest  radiograms  to  mammograms.  The 
following  methodology  is  being  followed.  (1)  Develop  a  computer  display  for 
mammograms  that  matches  the  grayscale  properties  of  the  display  to  the  contrast 
discrimination  function  of  the  observer’s  eye.  (2)  Interface  a  head-eye-position  recording 
system  to  the  display.  (3)  Develop  and  digitize  a  set  of  mammograms  with  barely  visible 
visual  cues  for  tumor.  (4)  In  a  case-control  study,  compare  detection  performance  with 
and  without  eye-position  feedback. 

PROGRESS  REPORT: 

Evaluation  of  the  Performance  of  the  Mammogram  Display  Station 

The  mammography  display  station  has  been  implemented  using  a  SUN  SPARC 
10,  Dome  video  controller  boards  and  two,  Tektronix  GMA  201  monitors.  The  active 
display  area  is  26  x  26  cm  with  a  pixel  matrix  of  2048  x  2048  x  8.  The  images  are  stored  in 
a  16  bit  buffer  that  is  reduced  in  size  (2048  x  2048  pixels)  and  driving  intensity  (8  bit)  for 
display.  The  images  can  be  viewed  in  reduced  size,  natural  size,  and  magnified.  Reduction 
is  sometimes  necessary  to  fit  an  entire  breast  image  into  the  window.  Magnification  is 
limited  by  the  available  pixels  in  the  display  buffer.  No  pixel  replicating  is  permitted.  The 
monitor  gray  scale  has  been  perceptually  linearized  [Blume  et  al.,1993].  The  portion  of 
the  intensity  range  that  is  displayed  over  the  8  bit  display  range  is  determined  by 
adjusting  the  intensity  window  width  and  window  center. 

The  display  was  tested  using  a  set  of  87  mammograms  assembled  by  Dr.  Orel. 

The  set  consisted  of  34  cases  with  validated  microcalcifications  without  masses,  28  cases 
with  validated  masses  without  microcalcifications  and  25  case  matched,  control  images. 
The  matching  of  controls  is  by  age,  sex,  and  major  incidental  image  features.  The  validity 
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of  the  normal  images  was  determined  by  stability  of  the  image  findings  for  at  least  two 
years  prior  to  the  test  mammogram.  The  images  were  digitized  with  two  digitizers. 
Digitizer  A  (Lumisys)  had  a  nominal  scanning  spot  size  of  100  microns  and  produced  a 
2030  X  2540  x  12  bit  image  from  a  20  x  25  cm  mammogram.  Digitizer  B  (DBA)  had  a 
nominal  spanning  spot  size  of  43  microns  and  produced  a  5075  x  6350  x  16  bit  image  from 
a  20  X  25  cm  mammogram.  The  images  were  read  by  three  experienced  mammographers  on 
film,  and  on  the  display  station.  The  readers  responses  were  recorded  using  a  5  level 
rating  scale  format  which  is  consistent  with  the  receiver  operating  characteristic  (ROC) 
analysis.  The  data  were  analyzed  using  ROCFIT  [Metz,1986]  and  the  area  under  the 
ROC  curve  Az  determined  for  the  detection  of  masses  and  calcification  and  for  the 
classification  of  masses  and  calcification  as  benign  or  malignant.  The  results  of  the  ori^nal 
test  (Rl)  and  a  replication  of  the  test  (R2)  made  after  a  lapse  of  six  months  are  shown  in 
the  Table  1. 

Table  1;  The  performance  of  three  readers  given  as  the  area 
under  the  ROC  curve,  Mean  (St.Dev.). 

Detection  Classification 


Calc’n 

•  Mass 

Calc’n 

Mass 

Film 

(Rl) 

.98  (.02) 

.95  (.03) 

.82  (.06) 

.77 

(.08) 

Scanner  A 

(Rl) 

.91  (.04) 

.92  (.04) 

.76  (.09) 

.75 

(.09) 

(R2) 

.91  (.05) 

.87  (.07) 

.85  (.07) 

.63 

(.15) 

Scanner  B 

(Rl) 

.91  (.07) 

.93  (.04) 

.62  (.10) 

.76 

(.10) 

(R2) 

.87  (.09) 

.90  (.05) 

.75  (.10) 

.75 

(.10) 

The  data  indicate  that  the  di^tizer-display  combination  degrades  tiie  detection  of 
microcalcifications  (The  difference  of  .07  is  significant ,  p  <  .05)  but  not  the  detection  of 
masses.  Classification  shows  more  variation  (.62  to  .85  for  calcification  and  .63  to  .76  for 
masses)  but  is  not  affected  by  digitization  and  soft  copy  display.  This  sample  could  not 
show  a  difference  between  digitizer.  The  limitation  may  be  in  the  display. 

Confirmation  that  Gaze  Duration  Predicts  the  Location  of  Tumors  by  Eye-position 
Recording  During  Search 

The  Applied  Science  Laboratories  (ASL)  eye  and  head  position  monitor  has  been 
used  to  record  the  ^e-position  of  3  mammographers  during  the  search  for  tumors.  We 
have  confirmed  the  observation  that  false-negative  decisions  are  associated  with  prolonged 
visual  dwell  time.  (This  also  has  been  confirmed  independently  by  Krupinski  and  Nodine 
[1994].)  The  ASL  eye  and  head  tracker  has  an  accuracy  of  .5  d^ees  (.5  cm  at  57  cm 
viewing  distance)  and  a  precision  of  .3  degrees.  This  means  that  95%  of  x,y  coordinates 
are  within  .3  degrees  of  the  recorded  value  (precision)  and  that  95%  of  the  recorded  values 
are  within  .5  degrees  of  the  location  of  the  fixation.  Tlus  level  of  precision  and  accuracy  is 
adequate  for  identifying  image  sites  that  receive  long  visual  dwell. 

Observations  on  the  Method  for  Providing  Visual  Feedback 
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Visual  feedback  is  provided  by  putting  a  five  degree  circle  around  the  suspicious 
site.  Krupinski  et  al.  [1993]  observed  that  the  circle  itself  increased  the  detectability  of 
lung  tumors.  We  perfomed  two  experiments  to  study  the  effect  of  using  a  bold  circle  as  a 
visual  prompt. 

The  first  experiment  used- a  background  of  gausian  noise  containing  a  1  cm  object  that 
simulated  a  mass  on  a  mammogram.  Three  observers  participated  in  a  two  alternative 
forced  choice  (2APC)  task  to  measure  the  detectability  of  the  mass  as  a  function  of 
contrast.  The  index  of  detectability  d’  was  measured  using  standard  signal  detection 
procedures.  The  mass  was  always  displayed  in  the  center  of  a  defined  field  with  a 
uniformly  noisy  gray  background.  Two  conditions  were  compared:  the  uniform  field  and 
the  field  containing  a  bold  5  degree  circle.  The  results  in  the  graph  below  show  that  the 
circle  enhanced  detectability. 


The  second  experiment  used  a  section  of  a  mammogram  as  the  background  in  addition  to 
the  same  level  of  gausian  noise  as  was  used  in  the  first  experiment.  The  results  show  that 
the  addition  of  the  mammogram  as  a  background  decreases  the  detectability  at  the  two 
contrast  levels  and  that  the  addition  of  a  bold  circle  to  the  display  enhances  the 
detectability. 


Mass  Detection 


2.5 


Noise-only 


Noise+Mammo 


We  hypothesize  that  the  circle  acts  as  a  fiducial  marker  for  the  visual  scanning  system 
allowing  stabilization  of  visual  drift  which  has  the  effect  of  increasing  the  contrast 
sensitivity  of  the  retina  [Kundel,  1995  ].  Data  to  test  this  hypothesis  has  been  collected 
but  has  not  been  fully  analyzed. 

Comparison  of  Detection  Performance  With  and  Without  Perceptual  Feedback 

The  eye-position  recording  system  is  functioning  in  a  satisfactory  manner.  We  and  others 
have  shown  that  areas  containing  masses  on  mammograms  receive  prolonged  visual  dwell 
even  when  they  are  not  reported.  We  also  have  show  that  a  5  degree  bold  circle  placed  on 
the  image  enhances  the  detectability  of  masses  embedded  in  gausian  noise  and  in  breast 
parenchyma.  It  now  remains  to  couple  the  two  phenomena  in  real-time,  in  order  to 
demonstrate  that  computer  assisted  visual  search  improves  performance.  This  portion  of 
the  experiment  will  be  completed  as  funding  becomes  available. 


SUMMARY 

We  have  developed  a  system  for  providing  visual  feedback  in  response  to  measurement  of 
gaze  duration  during  the  viewing  of  mammograms  on  a  video  display.  We  have  shown 
that  the  display  has  satisfactory  fidelity  and  that  the  precision  and  accuracy  of  the  eye- 
position  tracker  is  adequate  to  provide  reliable  feedback.  The  feedback  consists  of 
drawing  a  bold  circle  of  5  degrees  diameter  around  the  suspicious  site.  The  drcle  has  been 
studied  independently  as  a  visual  prompt  and  has  been  shown  to  be  an  effective  method 
for  enhancing  visual  performance.  The  neurophysiologic  reason  for  the  enhancement  is 
under  investigation.  A  practical  test  of  computer  assisted  visual  search  is  being  planned. 
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Project  1B:  Digital  Imaging  Processing  of  Mammography  Films. 

Project  Director:  Peter  Bloch, Ph.D 

Introduction 

The  treatment  of  small  breast  lesions  (less  than  1  cc  in  volume)  with  lumpectomy 
and  definitive  radiation  therapy  results  in  excellent  clinical  results  with  1 0  year  disease  free 
survival  better  than  95  %.  Thus  early  detection  and  treatment  of  breast  neoplasms  when 
the  lesions  are  too  small  to  be  palpable  is  most  likely  to  be  effective  in  sterilizing  the  tumor 
(Tabar  et  al.,1992).  Mammography  examinations  are  a  proven  diagnostic  procedure  for 
detecting  early  breast  cancer  in  asymptomatic  women  (Moskowitz,1 984,Kopans,1 984  and 
Feig,1988). 

Despite  the  documented  potential  for  mammography  to  result  in  decreased  breast 
cancer  mortality,  there  is  some  concern  that  some  segments  of  the  population  are  not  fully 
benefitting  from  the  examination  because  of  variations  in  quality  and  interpretation  of  the 
mammograms  performed.  The  radiographic  appearance  of  the  female  breast  differs  among 
women  in  relation  to  the  amounts  of  fat  ancf  fibroglandular  (connective  and  epithelial)  tissue 
present.  Areas  of  fat  are  radiographically  lucent  while  fibroglandular  tissue  are  radiographic 
dense.  Many  studies  have  looked  at  the  relationship  between  mammographic  density  and 
the  risk  of  developing  breast  cancer, and  the  majority  of  the  studies  have  found  an 
association  between  parenchymal  patterns  and  risk  of  developing  breast  cancer.  A  recent 
meta-analysis  confirms  the  association  of  increasing  risk  with  increasing  percentage  of 
density  of  the  breast  (Oza  and  Boyd, 1993  and  Warner  et.al.,1992).  The  degree  of 
increased  risk  associated  with  elevated  density  may  be  greater  than  any  other  generally 
recognized  risk  factor  for  breast  cancer, with  the  exception  of  the  presence  of  the  BRACA1 
gene  (Oza  and  Boyd,1993). 

A  subjective  evaluation  of  parenchymal  density  on  mammograms,  the  Wolfe 
classification  scheme  (Wolfe, 1976),  was  used  for  many  years,however  interobserver 
variability  was  a  significant  problem  (Moskowitz  et.al.,1 980,Myers  et.al.,1 983,and  Carlisle 
et.al.,1983).  It  is  widely  assumed  that  the  sensitivity  of  mammography  is  lower  in  women 
with  increased  mammographic  density,but  the  magnitude  of  the  decrease  sensitivity  has 
not  been  studied.  This  is  partially  due  to  the  lack  of  a  quantitative  measure  of 
mammographic  density.  A  computer  assisted  method  for  quantifying  mammographic 
density  as  a  percentage  of  the  image  area  can  overcome  this  limitation  (Boyd  et.al.,1 995 
and  Byng  et.al.,1 994).  One  of  the  goals  of  this  research  project  was  to  use  computer 
techniques  to  quantify  stromal  or  parenchymal  patterns  on  mammograms.. 

Characterization  of  the  breast  parenchyma  involves  analyzing  the  diffuse 
mammographic  density  pattern  which  depends  on  the  low  frequency  components  in  the 
mammography  image.  Tumors  of  diffuse  histology  are  more  difficult  to  detect  in  the 
presence  of  increased  mammographic  density  (Kopans,1992),thus  breast  density  may  be 
the  primary  cause  of  missed  carcinomas  (Kopans,1992  and  Hollingsworth  et.al.,1993). 
Estimates  of  the  number  of  women  with  mammographically  dense  breast  varies  between 
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1 0-35  percent  (Kopans.l  992), decreasing  with  age.  For  example, Wolfe  et.  al.(1 987), showed 
that  66%  of  women  over  53  years  old  had  less  than  25%  parenchyma  density  compared 
to  37%  of  younger  women  in  that  category.  Computer  identification  and  processing  of 
mammographic  dense  mammograms  could  be  an  important  tool  for  reading  these  difficult 
mammographic  cases. 

Another  goal  of  this  research  project  was  to  improve  the  detectability  of  breast 
lesions  using  computer  assisted  identification  of  clusters  of  microcalcifications  on 
mammograms.  Clusters  of  microcalcification  on  mammograms  is  a  radiographic  feature 
often  identified  in  early  stage  breast  cancer  (Sickles, 1986).  Approximately  30-50%  of  the 
breast  carcinomas  are  detected  by  microcalcification  on  mammograms  and  60-80%  of 
biopsied  confirmed  breast  carcinomas  show  microcaicification  on  histopathology  samples. 
Thus  reliable  identification  of  small  clusters  of  microcaicification  is  a  major  importance  in 
screening  women  for  early  stage  disease.  Research  groups  are  developing  computerized 
techniques  for  identifying  microcalcifications  on  mammograms  (Chan  et 
al.,1 987,1 988,1 992,Fam  etal.,1988,Daviesand  Dance  1990).  Studies  from  the  University 
of  Chicago  report  85  percent  true  microcaicification  identification  on  mammograms  using 
computer-aided  detection  (CAD)  of  microcaicification  (Wu  etal.,1 992,Zhang  etal.,1 992, and 
Ema  et  al.,1 993).  CAD  techniques  developed  by  Zheng  et.al.,(1995)  using  topographic 
feature  analysis  also  report  a  false-positive  detection  rate  to  0.18/image  or  82%  true 
microcaicification  detection.  In  the  above  studies  the  mammograms  were  digitized  at  100- 
175  microns  with  10  bits  of  dynamic  range.  To  further  improve  on  the  computer-aided 
detection  of  microcaicification  a  higher  quality,high  resolution  mammographic  film  digitizer 
was  employed  to  preserve  the  spatial  resolution  and  wide  latitude  of  the  original 
mammography  film  image. 


B:  Body  :  Accomplishments  of  the  Project: 

B.1  Digitized  Mammography  Database 

Software  and  hardware  tools  for  archival  and  retrieval  of  high  resolution  digital 
mammography  images  are  now  available  for  routine  use.  The  software  for  rapid  display 
of  digitized  mammographic  images  with  user  selected  contrast  and  magnification  has  been 
developed  using  the  Interactive  Data  Language,  IDL,  package  which  is  readily 
transportable  to  different  computer  platforms.  A  database  of  clinical  mammograms  was 
established.  Dr.  Susan  Orel,  a  mammographer,  identified  87  clinical  mammograms;  twenty- 
five  normals,  thirty-four  with  histopathology  confirmed  microcalcifications  and  twenty-eight 
with  solid  tissue  masses.  Each  mammogram  was  scanned  twice  with  two  different 
microdensitometers:  (1 )  Lumisys-1 00  microdensitometer,  using  a1 00  micron  pixel  size  and 
1 2  bit  dynamic  range  and,  (2)  a  DBA  microdensitometer  with  a  42  micron  pixel  size  and  1 6 
bit  gray-scale.  The  digitized  images  were  stored  for  archival  on  an  optical  disk.  The  size 
of  the  database  of  digitized  mammography  images  is  approximately  6  gigabytes. 


13 


B.2  Performance  Characteristics  of  Microdensitometers: 

The  performance  characteristics  of  two  microdensitometers;  (1)  Lumisys-100 
empioying  100  micron  pixeis  and  (2)  DBA  were  evaluated  for  digitizing  mammography 
films.  There  characteristics  are  summarized  below. 

B.2.1  LUMISYS-100  MICRODENSITOMETER 

The  microdensitometer  employs  a  2  mW  helium-neon  laser  beam.  Precision 
mirrors  mounted  on  a  precision  galvanometer  movement  is  used  to  sweep  a  1 00  micron 
light  spot  across  the  image  plane.  The  light  transmitted  through  the  film  is  detected  with 
a  photomultiplier  tube,  the  signal  from  which  is  logarithmically  amplified  and  digitized. 
Linear  regression  analysis  of  the  microdensitometer  output  with  optical  density  is  shown 
in  fig.  1 .  The  maximum  signal  intensity  occurs  at  approximately  2.5  OD,  corresponding  to 
a  useful  dynamic  range  of  1 1  bits.  However  the  noise  evaluated  from  the  analysis  of  the 
relative  standard  deviation  in  the  output  from  a  region  of  interest,  ROI,  of  10,000  pixels 
increases  from  approximately  0.3%  at  2  OD  to  0.9  %  at  2.5  OD  which  further  reduces  the 
useful  dynamic  range  of  the  scanner. 


OPTICAL  DENSITY  (OD) 

Fig.l :  Lumisys  microdensitometer  output  with  optical  density 

The  modulation  transferfunction,MTF,forthe  microdensitometer  was  determined  by 
taking  the  Fourier  transform  of  a  line  spread  function  derived  from  the  gradient  of  a 
measured  edge  spread  function.  The  edges  of  square  cut-outs  in  opaque  films,  4  OD, 
were  scanned  to  measure  the  edge  spread  function.  The  edge  spread  function  was  found 
to  be  nearly  the  same  for  all  the  edges  of  the  square  cutouts.  The  calculated  MTF  is 
shown  in  fig.2.  The  highest  spatial  frequency  is  the  Nyquist  cutoff  frequency,5  cycles/mm, 
associated  with  the  1 00  micron  pixel  size. 
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Frequency  (cydes/mm) 


Fig.  2  Modulation  Transfer  Function  for  Lumisys  Microdensitometer 
B.2.2  DBA  Microdensitometer 

The  DBA  microdensitometer  scans  the  image  plane  with  a  42 
source  obtained  from  a  temperature  controlled  masked 

is  detected  with  a  6048  linear  array  charge  coupled  ^  renSires 

by  moving  the  film  across  the  line  source.  Digitizing  a  10x12  inch  mammogram  requires 

of  me  Lsito  is  exponential  in  me  opS<f  den^i^^ 

OD  (fig.  3).  Routine  clinical  mammograms  contain  regions  of  high  density 

'  ^ . .  .  .  . _ .  ^ _  •  ^ -1  T  _  4  on  O'rT  Cri  1  1t 


OPTICAL  DENSITY  (OD) 

Rg.  3  Output  of  DBA  scanner  as  a  function  of  optical  density 

The  MTF  for  the  densitometer  were  derived  from  the  ®^9e 

a  single  42  micron  wide  scan  line.  The  measured  ®clge  was  found  to  p 
of  the  square  cutout  scanned.  Fig.  4  shows  that  in  the  ^  .  *ug 

edge  is  blurred,  and  sharp  in  the  direction  that  the  film  is  being  Hirprtion  that  the 

direction  of  the  line  source  is  scattered,  producing  9’®'^®^^®'!?®?  ' £  xj-p  effects  of  glare 
film  moves  the  registration  of  the  light  source  and  detectors  eliminates  the  effects  of  glare. 
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Fig.  4.  Edge  measured  with  the  DBA  microdensitometer.  Scanned  in  the  direction  of  the 
line  light  source, (solid  line  ),and  perpendicular  to  the  light  source  (dotted  line). 

The  edge  spread  function,  ESF,  in  the  direction  of  the  line  light  source  was  found 
to  be  nearly  independent  of  irradiated  area,  over  the  range  studied  1  -25  cm®.  This  area  was 
defined  by  cutouts  in  opaque  films.  In  addition,  placing  neutral  density  filters  between,0.25- 
0.98  OD,  over  the  square  opening  did  not  significantly  alter  the  measured  ESF. 

The  MTF  derived  for  edge  spread  functions  are  shown  in  fig.  5.  The  high  frequency 
cutoff  is  at  the  Nyquist  frequency  1 1 .9  cycles/mm  corresponding  to  the  pixel  size  of  42 
microns.  The  MTF  at  lower  frequencies  is  significantly  reduced  In  the  direction  of  the  line 
source.  Thus  the  degradation  in  image  quality  associated  with  the  presence  of  glare  is 
predominately  in  the  low  frequency  components.  This  would  suggest  that  the  effects  of 
glare  on  the  image  can  be  significantly  reduced  by  filtering  the  low  frequency  components 
measured  in  the  direction  of  the  light  source. 


Fig.  5:  MTF  for  the  DBA  microdensitometer.  Scanned  in  the  direction  perpendicular  to 
the  line  light  source,(solid  line  ),and  in  the  direction  of  the  light  source  (dotted  line). 
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Figure  5  indicates  that  the  noise  in  the  direction  of  the  line  source  is  much  greater 
than  the  noise  in  the  direction  perpendicular  to  the  light  source.  Noise  could  arise  from 
fluctuations  in  the;  (1)  light  intensity  along  the  light  source,  (2)  cross  talk  between 
elements  in  the  large  linear  CCD  detector  array,  and  (3)  analog  to  digital  conversion. 

Figure  6  shows  the  relative  noise  power  spectra  measured  in  three  regions:  (1) 
within  the  square  cutout  region  containing  no  film,  (solid  line),  (2)  in  an  opaque  area  lateral 
to  the  square  cutout  in  the  direction  of  the  line  source,  (dashed  line),  and  (3)  in  an  opaque 
area  perpendicular  to  the  direction  of  the  line  source,  (dotted  line).  In  region  2,  the  noise 
is  associated  with  glare,  which  decreases  with  increasing  spatial  frequency.  In  region  3, 
the  noise  is  a  low  level  white  noise.  In  region  1 ,  superimposed  on  the  noise  due  to  glare 
is  shot  noise  associated  with  the  linear  array  CCD  detector. 


Fig.  6  Relative  noise  power  for  the  DBA  scanner.  Solid  line,  region  of  high  light  signal,  and 
opaque  regions;  (dashed  line),  lateral  to  the  square  cutout  in  the  film  in  the  direction  of  the 
light  source,  and  (dotted  line)  perpendicular  to  the  direction  of  the  linear  light  source. 

The  implication  of  noise  on  visual  perception  of  microcalcification  and  masses  on 
digitized  images  is  not  clear .  However,  the  directional  dependence  of  the  noise  may  have 
some  implications  in  computer  aided  detection, CAD, of  clusters  of  microcalcification.  The 
increase  in  shot  noise  associated  with  the  signal  intensity  may  have  implication  in  using 
CAD  for  identifying  microcalcification  in  regions  of  dense  breast  tissues. 
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A  comparison  of  the  two  MTFs  in  figures  2  and  5  for  the  Lumisys  and  DBA 
scanners  respectively  demonstrates  the  improvement  in  the  physical  performance  of  the 
higher  resolution  scanner.  The  results  of  the  observer  testing  described  in  project  1B 
showed  however  that  digitized  images  produced  by  both  microdensitometers  resulted  in 
comparable  performance  in  identifying  clustered  microcalcifications  and  masses  on 
mammograms.  However,  these  evaluation  did  not  permit  the  observer  to  alter  the  display 
contrast.  The  ability  to  vary  contrast  may  be  a  useful  tool  for  the  reader  in  searching  for 
microcalcification  in  difficult  high  mammographic  density  regions  of  the  mammogram  (Taylor 
et  al.,1994).  The  16  bit  digitization  depth  available  with  the  DBA  scanner  may  be 
important  for  preserving  the  wide  latitude  of  the  mammographic  film  study, however  the 
dynamic  range  requirements  for  digital  mammography  continues  to  be  investigated 
(Maidment  et  al.,1 993, Neitzel, 1994). 

Algorithms  were  developed  for  Identifying  clusters  of  microcalcifications  by 
analyzing  the  regional  distribution  in  the  image  of  the;  (1 )  power  at  high  spatial  frequencies 
(2)  fractal  dimension  (Lefebvre  et  al.,1 992,1 995  and  Priebe  et  al.,1994)  and  (3)  entropy. 

The  analysis  used  the  digitized  images  obtained  with  the  high  resolution  microdensitometer. 

B.3  Quantitative  Determination  of  Mammographic  Density 

B.3.1  Background 

To  quantitate  mammographic  density,  we  used  the  high  resolution  digitized  film  set 
described  above.  The  DBA  digitized  images  were  reduced  in  size  to  display  on  a  1k  x  Ik 
monitor.  We  developed  software  for  quantitative  analysis  of  mammographic  density  based 
on  the  method  described  and  validated  by  Byng  et.  al.  (1994)  but  with  modifications  to 
make  the  method  more  operator-independent.  To  determine  the  projected  area  of  the 
breast  on  the  image,  the  reader  selects  a  background  area  of  approximately  4x4  cm2 
which  contains  no  breast  tissue.  The  edge  of  the  breast  (i^,)  is  then  determined 
automatically  by  excluding  the  region  containing  all  signal  less  than  the  mean  +4  times  the 
standard  deviation  of  the  selected  background  region.  This  differs  from  Byng  in  that  this 
method  requires  a  knowledgeable  observer  to  select  the  skin  edge  of  the  breast.  With  our 
modification,  total  breast  area  can  be  determined  by  an  untrained,  naive  observer,  and  is 
highly  reproducible.  The  total  area  of  the  breast  is  designated  At,.  The  reader  then 
superimposes  on  the  digitized  image  color  computer-generated  contour  lines  of  constant 
signal  or  optical  density  and  selects  the  contour  line  (ld««)  that  encompasses  the  region  of 
high  mammographic  density  (Rgure  7).  The  area  of  increased  parenchymal  density  is 
equal  to  the  sum  of  pixels  above  the  threshold  (id«»)  value  designated  Apd.  The  percentage 
of  parenchymal  density,  PD,  is: 

PD  =  (Apd/Ad,)x100  (1) 

In  addition,  software  has  been  developed  to  produce  a  histogram  of  signal  Intensities 
from  the  digitized  image.  The  threshold  for  id,ns  can  be  interactively  selected  by  the 
observer,  as  described  above  by  Byng  et.  al.,(1994)  and  compared  with  the  histogram. 
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Fig.7.  Example  of  digitized  mammogram  with  computer  generated  skin  edge  (i«jg„red)  to 
determine  breast  area,  and  computer  generated  contour  line  (idans.yellow)  demarcating  area 
of  increased  parenchymal  density. 

A  typical  histogram  of  signal  intensities  associated  with  fatty,  low  density  tissue  is 
shown  in  Fig.  8  (left  panel)  .  Region  2,  above  a  signal  intensity  of  approximately  250 
corresponds  to  the  higher  density  fibroglandular  tissue.  The  first  derivative  of  the 
histogram,  ( dashed  line  insert  in  fig.8 ),  often  helps  to  demarcate  the  start  of  region  2. 


0  500  1000  1500  500  1000  1500  2000 

Signal  Intensity  Signal  Intensity 

Fig.  8  Analysis  of  signal  intensities  in  mammogram;  Lt.  Panel:  Histogram  showing  number 
of  pixels  with  various  intensities  (solid  line), derivative  of  histogram(dashed  line);Rt.  Panel: 
Fractional  breast  area-signal  cumulative  histogram. 
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The  cumulative  histogram  could  also  be  of  use  to  evaluate  the  fractional  area  of  the 
image  above  a  particular  signal  intensity.  A  cumulative  histogram  can  be  modeled  as  a 
sum  of  normal  distributions  with  different  means  x(i)  and  Gaussian  spread  parameter  c(i) 
by  the  integral.  The  breast  tissue  area  F(^  having  signal  intensity  less  than  ^  is 

F(^)=  J  {N(1)exp-a(1)'(^-x(1))^  +  N(2)exp-a(2)(^-x(2))2++++}d^  (2) 

0 

where  N{1)  and  N(2)  are  the  number  of  events  in  peaks  x(1)  and  x(2)  respectively.  The 
Gaussian  spread  parameters  can  be  evaluated  from  the  full-width  half-maximum  for  each 
peak  in  the  histogram  distribution.  The  fractional  area  of  a  mammogram  having  a  signal 
intensity  below  a  particular  level  F(^)  /  F(oo)  is  shown  in  fig.  8  (right  panel).  As  a  first 
approximation  the  break  from  the  linear  portion  of  the  sigmoid  curve  was  used  to  determine 
the  fraction  of  elevated  density  in  the  image  which  is  1  -  0.64  =  0.36  or  36%  for  this 
example.  In  practice,  however,  a  least-square-fit  to  the  cumulative  histogram  is  employed 
to  extract  the  fraction  of  elevated  tissue  in  a  mammogram. 

B.3.2  Results  of  Mammographic  Density  Analysis 

Twenty  mammograms  from  a  test  set  were  randomly  selected  for  this  preliminary 
study  to  demonstrate  methods  and  data  analysis  of  (a)  the  inter-radiologist  reliability  of  the 
radiologists’  assessments  of  density:  and  (b)  the  concordance  between  radiologist 
assessment  of  density  and  computer-measured  density.  The  original  films  were  presented 
independently  to  3  radiologists  who  assigned  1  of  4  subjective  categories  of  density  to  each 
case.  The  4  categories  were:  (1)  less  than  25%  high  density,  (2)  25  to  49%  high  density, 
(3)  50  to  75%  high  density,  and  (4)  greater  than  75%  high  density. 

Computer-assisted  measurement  of  high  density  parenchyma  was  performed  as 
described  above  on  the  digitized  images  of  the  same  cases.  The  quantitative 
measurements  were  performed  by  a  physicist  unfamiliar  with  interpreting  mammograms, 
assisted  by  a  student  research  assistant  with  no  mammography  experience.  The 
cumulative  histograms  were  used  to  evaluate  the  percentage  of  mammographic  area  with 
high  density. 

1.  Table  3  gives  mean  radiologist  assessment  (1-4  scale)  for  each  radiologist: 


Table  3 


Radiologist 

Mean 

SD 

1 

2.5 

1.1 

2 

2.8 

1.1 

3 

2.5 

1.2 

An  analysis  of  variance  (ANOVA)  model  including  radiologist  and  patient  number  as 
factors,  showed  significant  differences  among  radiologists  (p  =  0.017)  on  this  assessment. 
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The  patient  terms  are  needed  to  control  for  the  correlation  induced  by  having  three 
assessments  done  on  each  patient.  Essentially,  the  patient  terms  force  the  comparison 
among  radiologists  to  be  made  within  patient. 

2.  We  calculated  the  intraclass  correlation  coefficient  (ICC)  as  a  measure  of 
agreement  among  radiologists.  The  ICC  is  defined  as  the  ratio  of  the  among-patient 
variance  in  radiologist  assessrhents  to  the  total  variance  (among-patient  and  within-patient) 
in  radiologist  assessments  of  density.  Because  the  within-patient  variability  results  from 
disagreements  among  radiologists,  the  ICC  provides  a  measure  of  agreement.  The  values 
of  the  ICC  range  from  0  to  1 .  When  there  is  perfect  agreement  among  radiologists,  there 
will  be  no  within-patient  variability,  and  the  ICC  would  be  1. 

We  estimated  the  ICC  using  an  ANOVA  model  with  radiologist  assessment  as  the 
outcome  variable  and  patient  as  the  grouping  factor.  The  ICC  is  then  calculated  as: 

ICC=BMS  /  (BMS  +  (m-1  )WMS)  (3) 

where  BMS  is  the  "between"  patient  mean  square  form  the  ANOVA  model,  WMS  is  the 
"within"  patient  mean  square  from  the  ANOVA,  and  m  is  the  number  of  measurements  on 
each  patient,  in  this  case,  3.  The  calculated  value  of  the  ICC  for  the  data  was  0.89, 
indicating  excellent  agreement  among  radiologists.  This  probably  reflects  the  fact  that  the 
three  radiologists  practice  together. 

3.  Associations  between  the  quantitative  measure  of  density  and  the  radiologists’ 
assessments  were  evaluated  in  several  ways.  For  each  radiologist  individually,  and  then 
for  all  radiologists  together,  we  estimated  the  Spearman  correlation  coefficient  between  the 
assessment  and  the  quantitative  data  using  the  radiologist’s  assessment  as  an  ordinal 
predictor  variable.  Because  the  regression  values  were  in  nearly  perfect  agreement 
with  the  Spearman  coefficients,  only  the  Spearman  correlations  are  presented  (Table  4). 

Table  4 


Radiologist 

1 

2 

3 

Overall 


Spearman  Rho 
0.85 
0.79 
0.76 
0.79 


These  correlations  show  that  there  is  excellent  agreement  between  the  radiologists 
subjective  assessments  and  the  quantitative  measurements  made  by  untrained  observers. 
The  overall  for  the  regression  described  above  was  0.64,  corresponding  to  a  Pearson 
correlation  of  0.8,  again  nearly  perfectly  consistent  with  the  Spearman  correlations. 

4.  Table  5  shows  the  ranges  of  quantitative  values  for  each  category  of  the 
radiologist’s  subjective  assessment,  along  with  the  means  and  standard  deviations  of  the 
means  for  each  category.  The  mean  was  calculated  for  all  assessments  at  a  particular 
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value,  regardless  of  the  radiologist  or  the  patient.  In  other  words,  every  radiologist’s 
assessment  of  every  patient  that  was  a  “1 ",  is  included  in  the  summary. 

This  again  shows  the  string  association  between  the  subjective  and  objective  scores, 
but  there  is  considerable  overlap  of  the  ranges  of  quantitative  values  between  categories 
of  the  subjective  assessments.  Note  the  range  of  quantitative  values  grouped  by 
radiologists  into  a  single  category. 


Table  5 

Radiologist’s 

Range  of 

Mean 

SD 

Assessment 

Quantitative 

Quantitative 

value(%) 

value  (%) 

1  (<25%) 

12.36 

18.7 

6.7 

2  (25.49%) 

17-71 

38.3 

14.5 

3  (50-75%) 

29-85 

54.3 

21.5 

4  (>75%)) 

53-85 

67.8 

11.6 

B.4  Computer  Aided  Detection  of  Microcalcification 
B.4.1  Background 

The  use  of  computer  aided  detection  (CAD)  of  microcalcifications  on  a  mammogram 
is  being  extensively  explored.  No  one  single  image  feature,however,by  itself  has  been 
identified  for  segmenting  a  possible  microcalcification  from  normal  tissue  and  image  noise. 
CAD  techniques  have  been  developed  where  the  signal  to  noise  ratio  of  microcalcifications 
are  first  enhanced  by  reducing  the  high  frequency  quantum  noise,and  removing  the  low 
frequency  structured  background  from  the  image.  Extraction  of  image  features  from  these 
filtered  images  using  local  adaptive  thresholding  procedures  in  conjunction  with  artificial 
neural  networks  have  been  successfully  employed  to  achieve  a  true  positive 
microcalcification  detection  rate  of  80-85%  (Chan  etal.,1 987,1 988,1 990).  CAD  techniques 
developed  by  Zhang  et.al.,(1995)  using  topographic  feature  analysis  also  report  a  false¬ 
positive  detection  rate  to  0.18/image  or  82%  true  microcalcification  detection.  To  further 
improve  on  the  computer-aided  detection  of  microcalcification  a  higher  quality,high 
resolution  mammographic  film  digitizer  was  employed  to  preserve  the  spatial  resolution 
and  wide  latitude  of  the  original  mammography  film  image. 

The  spatial  frequencies  in  mammography  images  is  greater  than  10  cycles/mm 
with  the  film-screen  combination  typically  employed.  The  Nyquist  frequency  corresponding 
too  1 0  cycles/mm  requires  that  the  pixel  size  be  less  than  50  microns.  In  the  above 
studies  the  mammograms  were  digitized  at  100-175  microns  with  10-11  bits  of  dynamic 
range.  Chan  et.al,(1994)  showed  however  that  detection  of  subtle  microcalcification  in 
mammograms  may  require  much  finer  resolution  e.g.  35  micron  pixels.  The  preservation 
of  the  higher  spatial  frequencies  in  the  digitized  mammogram  permitted  us  to  explore  use 
of  the  high  frequency  components  for  computer  identication  of  microcalcifications. 
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B.4.1 .1  Feature  Extraction  from  Digitized  Mammography  Images 


The  following  features  within  small  5x5  mnf  (128x128  pixels)  region  of  interests 
(ROI)  on  the  mammogram  were  evaluated;  (1)  signal  intensities  (2)  power  spectrum 
(3)  fractal  dimension  and  |4)  entropy. 

(1 )  A  histogram  of  the  signal  intensities  within  each  ROI  is  calculated  and 
used  to  identify  pixels  within  the  region  with  elevated  signals  that  may  be 
associated  with  microcalcifications.  The  histogram  is  used  to  determine 
the  average  signal  value  within  each  ROI  and  the  contrast  between  the 
individual  pixel  signal  and  the  average  value.The  region  is  flagged  as 
suspicious  if  a  small  fraction  (0.002)  of  the  pixels  in  the  ROI  have  a  signal 
intensity  that  results  in  a  contrast  of  greater  than  5%. 

(2)  The  power  spectrum  in  each  ROI  was  analyzed,  using  a  two 
dimensional  Fourier  transform  (2DFT) .  Regions  of  the  mammogram  with 
power  at  spatial  frequencies  greater  than  2  cycles/mm  were  flagged  as 
regions  that  may  contain  small  microcalcifications.  In  addition,  the 
directionality  0,  of  power  P(‘u)  at  spatial  frequency  v  was  evaluated  with 
the  following  expression; 

0(v)  =  tan-MPv(v)/Px(D)}  (4) 

where  Py(v)  and  Px(v)  are  the  spatial  frequency  components  of  the 
2D-Fourier  transform  in  the  two  orthogonal  directions  x  and  y.  Information 
on  the  directionality  of  the  power  spectrum  is  used  to  help  separate  ROIs 
with  significant  power  at  high  spatial  frequencies  due  to  microcalcification 
from  those  ROIs  that  have  sharp  boundaries  between  fat  and  high  density 
parenchyma  tissue.  The  directionality  of  power  associated  with  clusters 
of  microcalcifications  is  often  isotropic,  whereas  interfaces  between  tissue 
types  have  a  preferred  direction. 

(3)  The  fractal  dimension  (FD)  within  a  ROI  is  a  measure  of  the 
irregularity  of  the  signal  intensities  in  the  region.  A  constant  or  a  smooth 
variation  of  signal  intensities  within  an  ROI  would  approach  a  FD  of  2, 
whereas  the  presence  of  an  abnormality  such  as  microcalcifications  on 
a  relatively  smooth  background  of  breast  tissue  would  correspond  to  a 
rough  surface  approaching  a  FD  of  3.  Fractal  analysis  has  been 
employed  by  Lefebvre  et.al.,(1995)  and  Priebe  et  al.,1994  to  identify 
microcalcifications  within  small  regions  of  a  mammography  image.  We 
developed  an  algorithm  to  calculate  the  FD  from  the  variation  of  the  power 
spectrum  with  spatial  frequency  (Ruttimann  et.al.,1992).  The  calculated 
power  spectrum  P(v)  at  frequency  v  is  expressed  as  a  power  function 

P(\))  =  ai)**  or  log(P(\)))  =  log(a)  +  blog(v)  (5) 
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where  a  least  square  fit  of  log{P(v)}  vs  log(v)  was  used  to  determine  the 
value  of  b  and  its  associated  correlation  coefficient.  The  FD  in  each  ROI 
was  calculated  from  the  absolute  value  of  b  by  the  relationship  given  by 
Ruttimann,  et  al,  (1992) 

FD  =  3-(b-1)/2  (6) 

Due  to  the  sharp  discontinuities  associated  with  microcalcifications,  the 
fractal  dimension  in  regions  containing  microcalcifications  is  expected  to 
be  both  elevated  with  a  larger  standard  deviation  compared  to  normal 
tissue. 

(4)  Entropy  is  a  measure  of  the  disorder  within  an  ROI.  Regions 
containing  microcalcifications  may  be  more  disordered  than  a  region 
containing  normal  parenchyma  breast  tissue.  The  first  order  entropy  be 
(Pratt  ,1 978)in  each  ROI  was  evaluated  using  Shannon’s  Information  Law 


bE  =-''1  (N(b)  /  M)  *  logs  {N(b)  /  M)  (7) 

b=0 

where  0  <  b  <  L-1  denotes  the  quantized  amplitude  levels,  M  is  the 
number  of  pixels  in  the  region,  and  a  base-two  logarithm  is  utilized 
resulting  in  the  entropy  measured  in  bits. 


B.4.1 .2  Results  of  Extraction  of  Microcalcification  on  Mammograms 

An  example  is  shown  in  using  the  above  feature  extraction  algorithms  to  identify 
suspicious  regions  on  a  mammograms.  The  original  matrix  size  of  the  mammogram  shown 
in  fig.9  was  approximately  3000x5000  X  16  bit  which  was  reduced  5  fold  to  fit  on  the 
display  monitor.  The  analysis  was  performed  using  the  full  data  set.  The  povver  spectrum 
was  analyzed,  using  2DFT,  within  small  regions  5x5  mm*  (128x128  pixels)  of  the 
mammogram.  The  total  number  of  regions,  ROIs,  analysed  was  738.  Regions  with 
power  at  spatial  frequencies  greater  than  2  cycles/mm  are  marked  on  fig.  9.  The  DBA 
scanner  used  to  digitize  the  mammogram  has  an  MTF  of  0.75  at  2  cycles/mm  and  a 
Nyquist  frequency  1 1 .9  cycles/mm.  The  1 00  micron  pixel  size  used  with  tiie  Lumisys 
scanner  resulted  in  an  MTF  less  than  0.4  at  the  2  cycles/mm  threshold  frequency  used 
in  this  analysis  (and  zero  above  5  cycles/mm).  Regions  64  and  106  in  fig.  9  are  biopsy 
confirmed  microcalcification, region  256  is  a  lead  marker  placed  on  the  breast,and  regions 
172,21 4,21 8  are  near  signal  intensity  gradients  associated  with  the  interface  of  dense  and 
more  usual  parenchymal  tissue. 
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Table  6 


Region  # 

Relative 

Entropy 

64(pCa) 

1.0 

106  (pCa) 

1.87 

172  (tissue  interface) 

2.56 

214  (tissue  interface) 

3.47 

218  (tissue  interface) 

2.65 

256  (lead  marker) 

4.46 

Fig.9  Computer  designated  suspicious  regions  on  mammogram 

Besides  the  power  spectrum  the  additional  image  features  evaluated  in  each  ROI 
includes;  signal  intensity  distribution,  fractal  dimension  and  entropy.  In  this  example, the 
most  striking  difference  between  the  regions  with  microcalcifications  and  tissue  gradients 
was  in  the  entropy.  Table  6  shows  the  relative  entropy  in  the  ROIs  of  the  image  that  were 
flagged.  Entropy  is  a  measure  of  order,the  lower  the  entropy  the  greater  the  structure 
within  that  region  of  the  image. 
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B.5  Summary  and  Accomplishments: 

In  summary,  the  goal  of  the  project  was  to  use  computer  techniques  to  assist  the 
radiologist  in  reading  mammograms.  To  accomplish  this  task,  we  developed  a  data  base 
of  high  resolution  digitized'mammograms  consisting  of  nearly  100  studies  ( two  views  per 
study).  The  storage,  retrieval,  and  the  processing  of  these  large  datafiles  has  been  shown 
to  be  achievable  using  existing  computer  technology. 

Algorithms  were  developed  during  the  course  of  the  project  to  quantify  tissue  densities  on 
mammograms.  The  presence  of  increased  mammographic  density  has  been  previously 
identified  by  radiologists  as  a  primary  cause  for  not  detecting  carcinomas  on 
mammograms.  The  ability  to  quantify  parenchymal  density  mammograms  will  thus  allow 
physicians  to  readily  separate  the  "difficult  "mammograms  for  additional  study  or  analysis. 

To  detect  microcalcification  on  mammograms  we  developed  algorithms  that 
evaluated  image  features  in  5x5  mm^  regions  on  the  high  resolution  digitized 
marnmograms.  The  features  that  were  analyzed  include:  (1 )  signal  intensity  distribution  (2) 
spatial  frequency  power  spectrum,  (3)  fractal  dimension  and  (4)  entropy.  The  high  spatial 
frequencies  preserved  in  the  digitized  images  helped  in  computer  identifications  of 
microcalcifications.  In  addition,  the  disorder  in  the  tissue  parenchyma  associated  with  the 
presence  of  clusters  of  microcalcifications  can  be  quantified  by  evaluating  the  entropy  in 
the  region. 

As  these  findings  warrant  further  studies  (particularly  observer  performance 
confirmation)  we  are  requesting  continuation  of  the  project  without  any  additional  funding. 
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1.  INTRODUCTION  .  ,  .  ^  .  . 

The  long  term  objective  of  the  project  is  ultrasonic  echo-scanning  demonstration  ot 

the  detection  and  diagnosis  of  smaU  breast  tumors  of  a  few  mm  (-  2  mm)  iii  size. 
tumor  detection  requires  large  (~f/l),  2-D  transducer  array  (5-lOcm)  to  achieve  the  high 
lateral  resolution.  Imaging  from  so  large  an  aperture  suffers  wavefront  aberration.  The 
wavefront  aberradon  problems  inside  the  female  breast  ^e  caused  by  distortion  somces  of 
two  distinct  types,  isotropic  scattering  and  nonisotropic  muldpath  caus^  by  refracoon 
and/or  reflection.  Scattering  diminishes  contrast  resolution  (CR),  and  multipaA  mse 
targets  or  ghost  image  artifacts.  Both  reduce  CR  in  image.  We  seek  -60  to  -70  dB  CR  for 
echo  imaging  so  as  to  prevent  contamination  of  otherwise  black  cysts  with  scattered  and/or 
refracted  echo  energy  and  thereby  to  cause  them  to  look  like  speckled  tumors. 

The  tools  that  we  proposed  to  investigate  were  adaptive  signal  processing  meAods 
for  wavefront  distortion  compensation.  In  addition,  we  also  proposed  to  smdy  large 
aperture  design  principles  for  next  generation  high  resolution  ultrasound  breast  sewner.  In 
the  last  year,  we  found  that  applying  a  time  delay  type  algorithm  developed  by  Flax  and 
O'Donnell  (1988)  to  in  vitro  2-D  breast  data  and  the  algorithm  has  suppressed  scattered 
energy  and  folded  it  into  the  target  image,  increasing  CR  by  10-20  dB  (HinkelmM  et  al, 
1995,  Zhu  and  Steinberg,  1994).  Such  adaptive  algorithms  have  been  developed  m  many 
fields  in  the  last  20  years  (optics,  Muller,  1974;  radar,  Steinberg,  1^81;  i^o  ptronomy, 
Cornwell,  1989;  ultrasound.  Flax  and  O'Donnell,  1988,  Nock  era/.  ,1989,  Fink,  1992). 
These  are  global  algorithms  that  correct  time  delay  errop  in  wavefronts  caused  by 
inhomogeneous  tissue  and  leave  the  wavefront  amplitude  distortion  mtacL  This  type  of 
algorithm  is  well  understood  and  can  be  applied  to  echoscanners  with  modest  success. 
Recently,  we  have  had  a  leap  in  understanding  as  to  how  to  properly  treat  the  wavenx)nt 
amplitude  distortion  and  multipath  interference  problems.  Our  newest  Toward  Inve^ 
Filter  (TIF)  approach,  submitted  for  publication  (Appendix  A),  h^  shown  6-10^ 
improvement  in  CR  more  than  phase  conjugation,  the  best  phase  corr^tion  piwedure.  Oitf 
spatial  location  diversity  and  coherent  (XEAN  approach,  though  preliminary,  mcreases  CR 
by  "7  dB  (Appendix  G). 

2.  SUMMARY  OF  THE  ACHIEVEMENTS  ,  . 

There  were  four  major  tasks  in  the  proposal.  These  items  were  either  completed  or 
are  in  progress.  Publications  resulting  from  this  work  are  referenced  in  subpar.  1-4 
immediately  below. 

1.  Analyze  and  evaluate  1-D  in  vivo  breast  wavefront  data  from  a  point  source  mea¬ 
sured  with  a  10-cm  1-D  linear  array.  Extract  statistical  information  about  waveform 
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distortion  from  the  data.  This  information  is  valuable  for  the  design  of  stronger  wavefront 
compensation  algorithms. 

The  1-D  data  had  been  taken  at  Hosp.  Univ.  Pennsylvania  (HUP)  on  an  earlier 
Commonwealth  of  Pa.  grant  44  asymptomatic  women  who  had  x-ray  mammography  were 
smdied.  They  were  divided  into  three  approximately  equal  size  groups  -  premenopausal 
dense  breasts,  premenopausal  fatty  and  postmenopausal.  Propagation  path  in  tissue  was 
12  cm.  Frequencies  were  3  and  4  MHz.  Waveforms  were  wideband  (to  emulate  echo)  and 
narrowband  (to  avoid  frequency  selective  phenomena).  Statistics  were  obtained  and  pub¬ 
lished  on  wavefront  amplitude  distribution,  correlation  distance  and  image  sidelobe  levels 
caused  by  wavefront  distortion  [1 ,2,3,4], 

2.  Extend  measurement  capability  to  2-D.  Obtain  2-D  breast  data.  Analyze  as  in  item  1. 

2-D  breast  data  obtained  and  analyzed,  from  collaboration  with  URwhester  group  [5, 
6].  In  addition  to  analysis,  we  also  completed  a  theoretical  scattering  model  [7].  It 
predicts  halo  around  target,  calculates  halo  width  and  intensity,  calculates  loss  in  target 
contrast  and  dynamic  range  vs  array  size,  frequency,  propagation  depth  in  tissue,  phase  or 
timp.  delay  variance  in  tissue,  scatterer  size,  correlation  distance.  Compares  favorably  with 
reported  experimental  data.  The  model  can  be  used  to  guide  the  design  of  high  resolution 
ultrasound  systems. 

3.  Test  existing  phase  deabenation  algorithms.  Determine  suitability  to  high  resolution 
imaging  in  the  breasL  Develop  stronger  wavefront  compensation  algorithms  as  needed  to 
the  extent  possible. 

Existing  phase  deaberration  algorithms  were  tested  and  compared  both  theoretically  and 
experimentally  upon  2-D  measurement  data  (dominant  scatterer  (Steinberg,  1981)/  time  re¬ 
versal  mirror  (Fink,  1993),  time  delay  correction  (Flax  and  O'Donnell,  1988,  Nock,  et  al., 
1989),  backpropagation  plus  time  delay  (Liu  and  Waag,  1994))  [6,8].  Two  types  of 
stronger  wavefront  compensation  algorithms  have  been  developed.  These  are: 

a.  Toward  Inverse  Hltering  Approach 

2-D  data  analysis  and  2-D  algorithmic  studies  indicate  that  ultrasonic  wavefront 
distortion  inside  the  female  breast  falls  into  two  categories,  incoherent  scattering  and 
coherent  multipath.  Scattering  reduces  target  strength,  broadens  image  lobe  and  lowers  the 
image  contrast  while  refraction  creates  coherent  multipath  interference  that  produces  false 
targets  or  ghost  artifacts  in  the  image  [6,8].  Time-delay  type  compensation  algorithms  are 
useful  to  minimi  7ft  scattered  energy  and  to  improve  image  contrast  to  a  large  extent  (15  dB) 
[5,6].  Further  improvement  of  contrast  resolution  requires  compensation  algorithms  that 
can  compensate  wavefront  amplitude  distortion  and  remove  false  targets.  A  new  approach. 
Toward  Inverse  Filtering,  which  is  designed  to  solve  scattering  problem,  is  developed  and 
experimentally  demonstrated  using  2-D  in  vitro  measurement  data  [6,8].  Contrast 
resolution  has  been  improved  6  -  10  dB  more  than  the  best  phase  deaberration  procedure 
(phase  conjugation)  at  the  aperture. 

b.  Multipath  Identification  and  Cancellation  Procedure 

Multipath  interference  is  a  much  more  difficult  problem  than  scattering.  Because  it  is 
not  a  stationary,  stochastic  process,  two  distinct  steps  are  required  to  deabenate  refraction- 
contaminated  image.  It  is  first  necessary  to  recognize  which  target  is  the  true  target  and 
which  is  the  false  one  caused  by  interference.  In  [9]  we  demonstrate  that  when  a  cluster  of 
true  and  false  targets  is  imaged  from  several  different  array  locations  the  true  target  remains 
in  position  and  changes  very  little  in  size  and  shape.  The  images  of  false  targets,  on  the 
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other  hand,  are  highly  sensitive  to  the  direction  from  which  they  are  viewed.  Therefore, 
they  change  sufficiently  in  location,  size  and  shape  to  classify  them  as  false.  In  this  way 
the  recognition  problem  is  solved.  The  second  key  problem  is  the  canceUation  of  the 
multipath  arrivals.  In  [9],  we  show  that  coherent  CLEAN  deconvolution  tectoique  can  be 
used  as  a  tool  to  solve  the  second  problem;  a  single  pole  cancellor  has  offered  average  of  7 
dB  improvement  in  target  dynamic  range.  Sophisticated  cancellations,  which  are  now 
being  studied,  are  expected  to  offer  more.  '  These  results,  though  preliminary,  lead  to 
optimism  that  tiiis  approach  may  lead  to  the  solution  of  the  second  problem. 

4.  Design  and  test  2-D  large  acoustic  transducers  for  higher  resolution  imaging, 
a.  2-D  Acoustic  Array  Design 

Dramatically  reducing  the  number  of  transducer  elements  in  a  large  2-D  array,  call^ 
element  thinning,  is  essential  for  designing  a  practical  2-D  transducer  array,  ^atysis 
revealed  that  by  using  the  ultrawideband  (UWB)  property  of  this  array,  very  thm  high 
resolution  arrays  can  be  built.  Several  groups  have  studied  random,  spp’se,  tw^ 
dimensional  ultrasonic  arrays  (Turnbull  et  al ,  1992,  Cassereau  et  al  1992,  Davidsencr  al , 
1994).  They  chose  a  random  allocation  of  elements  in  order  to  avoid  the  gratmg  lobes  of  a 
periodically  thinned  array.  Consequently,  the  resulting  side  enwgy  of  the  radiaticHi  field  is 
much  higher  than  that  of  a  filled  array,  as  predicted  by  random  array  theory.  Diea  groups 
did  not  cpnjdHpT  the  ultrawideband  nature  of  currently  available  transducers  m  their  array 
design.  The  distribution  of  sidelobe  energy  from  an  UWB  array  is  very  different  fmm  a 
conventional  narrowband  (NB)  array.  Due  to  the  UWB  nature  of  the  pulse,  the  radiat^ 
waveform  from  UWB  arrays  varies  in  time  which  is  not  the  case  in  NB  arrays.  As  a  resm^ 
the  wavefOTm  has  an  extra  dimension  with  respect  to  NB  radiation  fields  acn^s  wiuch 
side  energy  can  be  distributed.  We  have  found  that  UWB  arrays  can  be  highly 
thinned  and  achieve  a  much  lower  side  energy  level  than  NB  arrays. 

Our  theory  and  simuiationg^'show  that  when  UWB  arrays  are  highly  thiimed,  there  exist 
regions  of  tiie  radiation  fields  where  there  is  no  interference.  NB  array  analysis  is  based  (M 
the  assumption  that  the  entire  radiated  field  has  interference;  therefore,  conventional  NB 
analysis  does  not  apply  in  highly  thinned  UWB  arrays.  The  analysis  to  date  established  a 
method  for  characterizing  the  radiation  from  highly  thinned  UWB  one-  and  two- 
dimensional  arrays.  This  method  simplified  the  radiation  field  by  analyzing  its  mterfaing 
and  a  non-interfering  regions  separately.  The  results  showed  that,  contrary  to  conyentiotiM 
wisdom,  a  periodic  array  is  preferred  over  a  random  array.  Furthermore,  to  achieve  the 
gflmft  high  resolution  and  low  side  radiation  level,  the  higUy  thinned  pmodic  UWB  array  is 
capable  of  reducing  the  number  of  elements  required  in  a  conventional  filled  array  to 
approximately  the  square  root  of  that  number.  We  call  such  an  array  a  VN  array. 

As  a  consequence  of  element  thinning,  there  is  a  loss  in  signal-to-noisc  because  of  tiw 
loss  in  aperture  area.  A  parametric  relation  was  drived  which  gives  the  minimuni  numi^ 
of  elements  required  to  insure  an  adequate  signal-to-noise  ratio.  Theoretically,  it  caii  be 
shown  that  the  Vn  array  is  capable  of  achieving  a  sufficient  signal-to-noise  ratio  for  pulse- 
echo  ultrasonic  imaging. 

b.  Equipment  for  Experiment  Program 

The  ultrasound  laboratory  is  fully  operational  and  is  used  daily  in  support  of  the 
experimental  program.  The  facility  includes  a  water  tank  test  chamber  that  is  desired  for 
3-D  synthetic  aperture  imaging  with  arbitrary  transducer  array  configurations  within  a  15- 
cm  cube.  A  three-axis  micro-positioner  table  with  linear  encodes  (purchas^  from  New 
F.nglanri  Affiliated  Technology)  provides  for  the  control  of  element  position  accuracy 
within  3  microns.  In  a  typical  experiment,  a  fixed  hemispherical  transducer  radiates  a  short 
pulse  (5(X)  nsec)  at  3.75  MHz,  and  a  0.6  mm  hydrophone  receives  the  resulting  waveform 
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at  each  desired  measurement  position.  Each  receiv^  waveform  is  ^pled  well  atow  the 

Nyquist  rate,  displayed  and  digitized  by  a  HP54120T  samphng  oscilloscope,  arid  storo^ 
a  desktop  computer.  The  entire  experiment  is  \inda  preprogranmed 
The  output  data  set  includes  a  received  waveform  from  each  receiving  elernen^attM. 
Each  data  set  is  then  operated  upon  by  relevent  software,  i.e.,  imaging,  Founer  transform, 

correlation,  etc. 

^^^tiv?wavefront  compensation  is  a.  useful  tool  to  increase  CR  for  utosOTic 

breast  imaWg  and  the  total  CR  improvement  in  point  source  image  is  about  25  dB.  The 
next  step  will  be  the  careful  evaluation  of  these  methods  using  2-D  large  aperture  pulse- 

echo  system  upon  m  vitro  samples  and  in  vivo  volunteers. 

Simulations  show  that  highly  thinned  UWB  arrays  are  able  to  aclueve  high  resolution 
and  a  low  side  radiation  level  while  maintaining  a  sufficient  signal-to-noise  level.  A 
periodic  configuration  of  elements  gives  a  lower  side  radiation  level  dm  a  r^dom  array 
and  is  able  to  reduce  the  number  of  elements  conventionally  requ^ed  by  a  filled  array  to 
about  the  square  root  of  that  number.  The  next  step  in  the  amy  design  is  to  experimentally 
verify  the  properties  of  this  VN  array  in  our  ultrasonic  experimental  system. 
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ADDENDUM  TO  GRANT  NUMBER  DAMP  17-93-J-3014 


Title;  Early  Detection  of  Breast  Cancer  on  Mammograms  using:  Perceptual  Feedback, 
Computer  Processed  Image  and  Ultrasound 

Principal  Investigator:  Peter  Bloch,  Ph.D. 

Report  Date:  May  30  1996 

Type  of  Report:  Report  for  the  period  12/30/95-4/30/96 


The  grant  was  extended  4  months  with  no  additional  funds.  The  extension  permitted  us 
to  further  study  digital  processing  of  mammography  images  to  improve  observer 
performance  in  identifying  microcalcification  and  masses. 


During  this  extension  period  techniques  were  explored  to  use  the  digital  mammograms 
more  readily  in  a  clinical  setting.  The  digitized  high  resolution  myograms  are  l^ge 
files  typically  30-50  megabytes.  Transferring  and  computer  processing  these  files,  which 
takes  approximately  5-10  minutes,  is  too  long  for  routine  clinical  use. 


We  investigated  reducing  the  mammogram  file  size  by  decreasing  the  nimber  o 
pixel.  The  digitized  images  are  obtained  at  16  bits/pixel.  Reducing  to  8  bits/pixel 
decreased  the  observers  ability  to  detect  the  boundary  of  the  breast  on  the  mammogram. 
In  addition,  when  the  number  of  bits/pixel  was  reduced  from  16  to  14  bits  the  computer- 
assisted  identification  of  microcalcifications  on  a  mammogram  was  adversely  affected 
The  reduction  in  the  number  of  bits/pixel,  changed  the  calculated  regional  distnbution  of 
fractal  dimension  and  entropy  within  the  mammogram.  The  fractal  dimension 
distribution  within  the  mammogram  image  (see  Final  Progress  report)  becme  a  less 
sensitive  indicator  of  the  presence  of  a  microcalcification  when  the  number  of  bits/pixe 

was  reduced. 


The  results  of  these  studies  show  the  importance  of  maintaining  m  the  digital  image  the 
wide  gray  scale  or  latitude  of  the  original  film-screen  mammogram. 


We  are  continuing  to  explore  other  techniques  (without  external  funding)  to  reduce  the 
digitized  mammography  file  size.  Cropping  the  image  to  include  only  *e  bi^  tisme 
siLficantly  decreases  the  file  size,  typically  30-50%.  The  automatic  detection  of  *e 
boundary  of  the  breast  on  the  mammogram  that  was  developed  durmg  the  course  of  the 
grant  will  be  employed  for  automatic  cropping  of  the  image. 


Recently,  we  have  been  made  available  the  high  resolution  digitized  mammography  data¬ 
base  and  the  algorithms  to  computer  process  these  images  to  the  National  Information 
Display  Laboratory  (NIDL)  at  the  David  Samoff  Research  Center,  in  Prmceton,  N.J. 
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Previously,  NIDL  developed  techniques  for  analyzing  aerial  photographs.  They  are  now 
interested  in  applying  these  techniques  for  detection  of  lesions  on  mammograms.  The 
collaboration  between  the  Univ.  of  Pennsylvania  and  NIDL  is  in  keeping  with  the  Public 
Health  Service  Women’s  Health  program  of  “Missiles  to  Mammogram”  initiatives.  The 
mammography  developments  at  our  institution  in  digital  mammography  and  breast 
cancer  detection  with  magnetic  resonance  imaging  and  spectroscopy,  both  supported 
with  DAMD  funds,  are  being  correlated  using  hardware  and  software  at  NIDL.  The 
combination  of  the  two  modalities  should  provide  additional  information  that  could 
significantly  improve  breast  cancer  diagnoses,  especially  in  difficult  to  read 
mammograms  of  dense  breast  tissue. 

Our  recent  developments  in  digital  mammography  has  also  result  in  a  potential 
collaborative  program  with  a  commercial  company  to  explore  using  solid-state  digitally 
acquired  mammograms  in  a  clinical  setting.  The  direct  digital  acquisition  of  a 
mammogram  may  be  essential  for  wide  spread  introduction  of  computer-assisted 
diagnosis  of  mammograms.  The  feature  extraction  algorithms  that  were  developed  for 
film-screen  mammograms  can  be  employed  with  these  digitally  acquired  images  during 
the  period  of  the  grant. 


